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(54) Method and apparatus lor transcoding moving picture data 



(57) The transformation method for moving picture 
coding system reads data of a frame from the first data 
sequence in the first moving picture moving coding sys- 
tem, prereads a coding mode of a successive frame to 
record, and when the preread coding mode of the suc- 
cessive frame is the intra-frame coding mode, performs 
a control not to perform coding of a present frame or 

CaimAtiaTiwn 



decrease a generated code amount con'e^nding to 
the generated coed content of the second data 
sequence in the second moving picture coding system. 
Then, the method preferentially transforms data coded 
by the intra-frame coding mode existing in the first data 
sequence to the second data sequence. 
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Description 

BACKGROUND OF THE INVENTION 
5 Field of the Invention 

10001] The present invention relates to a method and apparatus for transforming a moving picture coded by a cod- 
ing system into anoth«^ moving picture coded by another coding system. 

10 Description of the Related Art 

[0002] With the progress ot multimedia techniques for handling voice, image and other data collectively, conven- 
tional information media such as a newspaper, magazine, television, radio, and telephone, which are means for convey- 
ing information to people, become subjects for the multimedia. 
IS [0003] Generally, the multimedia are considered to show not only characters but also other information such as fig- 
ures, voices, or particularly images, associated with characters at the same time. In order to make the above-mentioned 
conventional information media the subjects for the multimedia, representing the conventional information in digital for- 
mat is the essential condition. 

[0004] However, the estimation of the code amount of each of the conventional information media in digital format 

20 results in 64 kb per second for voices (tel^hone quality) and equal to or more than 100 Mb per second for moving pic- 
tures (current television reception quality), while the code anwunt for a character is 1 to 2 bytes. Therefore, it is not real- 
istic to handle such a massive code amount in digital format without using any transformation. 
[0005] For exanrple. a video teleconferencing system is already put to practical use with an Integrated Services 
Digital Networks (ISDN) with a transmission rate of 64 kbps to 1 .5 Mbps. it is however impossible to transmit images for 

25 a television or camera directly without the transfbrmatmn with the ISDN. 

[0006] A data compression technique is consequently required. For example, the video teleconferencing system 
uses moving picture compression technk^ues of the H.261 standard and H.263 standard that are international-stand- 
ardized by the ITU-T (Telecommunication Standardization Sector of International Telecommuiication Union). 
[0007] Further, according to the information compression technique of the MPEG standard, ordinary television 

30 broadcast moving picture is compressed to 2 to 1 5 Mbps. 

[0008] Herein, the MPEG (Moving Picture Experts Group) means the operation group (ISO/IEC 
JTC1/SC29AAfG1i) working for the standardization of speech and moving picture coding in the ISO (Internatfonal 
Organizatfon for Standardization), and also means the international standardization of the data compression that this 
group defines, at the same time. Currently, the MPEG has standardized MPEG-4 enat>ling the coding and processing 

35 by an object tXL&s to achieve the new function needed for the multimedia technique. 

[0009] A plurality of moving picture coding standards are thus to be used, resulting in the problem to be solved that 
coded data (hereinafter referred to as bit-stream) in such standards is not compatible with each other. 
[0010] For exanrple. although a decoder based on MPEG-4 is specified to be capable of decoding H.263 bit- 
stream, there is generally no compatibility of bit-stream between coding systems of H.261 . H.263, MPEG-2 and MPEG- 

40 4 (in other words, it is not possible to use a coder and decoder based on different coding systems as a pair). 

[0011] This condition requires an apparatus that transforms bit-streams based on the different coding systems 
(hereinafter referred to as transcoder). 

[0012] FIG.1 illustrates a conceptual diagram of the transcoder. In FIG.1. different coding systems are A and B. 
decoder 101 wHh a system A and coder 103 with a system B are connected through a frame memory and image trans- 
45 former 102. 

[001 3] For exanple, it is assumed that the system A is MPEG-2 (picture size:704 x 460 pixels), and that the system 
B is H.263 (picture size:360 x 288 pixels). Although the picture sizes thereof are different from each other, it is possible 
to perform the transformation by once transforming the bit-stream to an image, and then coding the image again. 
[0014] In addition, the H.261, H.263. MPEG-2 and MPEG-4 coding systems use Motion-Compensated Discrete 
so Cosine Transformation coding system (hereinafter referred to as MC-DCT coding) as a common method. In the MC- 
DCT coding system, an image is divided into t>locks each of which is called a micro block comprised of 16 ^ 16 pixels, 
a shifted anruxmt (motion vector) ttiat minimizes a cfifferential between successive images (frames) is calculated, and , 
the differential is subjected to Discrete Cosine Transform (DCT) coding. 

[001 5] The processing to obtain the motion vector that minimizes the differential between the frames to obtain a dif- 
55 ferential image from which the redundancy is removed is called motion compensation. 

[001 6] DCT is used to remove spatial redundancy left in tfie motion-compensated image (differential image). 
[0017] In additfon. a first frame is coded using only DCT because the differential coding with another frame is not 
performed. Such a frame is called I picture, and other general picture to be subjected to MC-DCT coding is called P 
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picture. 

[0016] If the MC-DCT coding system as described above is used in the coding systems A and 6. it is possible in 
decoding in FiG.1 to obtain secondary information (hereinafter referred to as side information) generated in the MC- 
DCT coding such as moved infornfiation and DCT coefficient quantization, and it is expected that the use of the side 
£ information improves the conrputation efficiency and coding efficiency (image quality and coded content) in recoding 
[001 9] A conventional example of the transcoder using the side information is a moving picture coding transforma- 
tion apparatus disclosed in Japan Unexamined Patent Publication HEI10-271494. 
[0020] FIG.2 illustrates the concept of the apparatus. 

[0021] When it is assumed that the systems A and B in the transcoder illustrated In FIG.1 are respectively MPEG- 
10 2and H. 263. a configuration of 101 toi03 in FIG.1 corresponds to that of 202 to 204 in FIG.2. 

[0022] In the conventional example, since the tM/o coding systems have the MC-DCT coding system as the com- 
mon method, it is possible to omit motion vector searching in H.263 coding by executing scaling (transforming an abso- 
lute value by multiplying a ratio of picture sizes) on the motion vector obtained in MPEG-2 decoding. 
[0023] In the conventional example illustrated in FIG.2, with the motion vector adopted as the side information, the 
15 computation efficiency in recoding is improved using the side information otTtained in MPEG-2 decoding. 

[0024] In composing a practical transcoder, however, there are many subjects to be examined other than the reuse 
of motion vector. 

[0025] In the practical coder, a process called rate control is inevitable to adjust the code amount of btt-streartis out- 
put therefrom. 

20 [0026] Generally, an output buffer is installed at an output side to absorb a variation of generated code amount, and 
corresponding to the buffering data in the output buffer (hereinafter referred to as buffer loaded code amount), the 
coded content is adjusted. 

[0027] In the MC-DCT coding system, the coded content adjustment is executed by setting the quantization accu- 
racy for the DCT coefficient to variat>le (fine accuracy improves the image quality and increases the generated code 
25 amount, while rough accuracy results in the opposite effects). 

[0028] FIG S illustrates a conceptual diagram showing subjects for the transcoder 

[0029] An output terminal of output buffer 304 is connected to a communication path or storage medium. When it 
is assumed that the communication path has a fixed data rate, the bit-stream Is output from the output buffer with the 
constant rate. Coder 303 with the system B adjusts the generated code amount so that data in txjffer 304 is not con- 

30 sumed (underflow) or not excessive (overllow). Meanwhile, in order to improve the receded image quality, it Is neces- 
sary to use the side information concerning coding procedure such as quantization and coding mode. Generally 
speaking, when a coder with the system 6 is operated independently of the coding procedure of the system A, an image 
quality loss generated by the system B is added to the image quality loss generated by the system A. 
[0030] For example, it is assumed that the bit-stream of the system A is coded at a rate of 1 0 frames/sec. When the 

35 reproduced resuK is receded by the system B independently at a rate of 15 frames/sec, a frame with the system B of 
which the coding time accords that with the system A is one frame in three frames. In other words, the decoding inter- 
vals of other two frames do not accord with the original moving picture. Therefore, despite the frame rate being 
increased, the decoding result by the system B may not maintain, or even decrease the image quality of the system A. 
(0031 ] The same phenomenon occurs in the quantization of DCT coefficient. It is assumed that the quantization in 

40 the system A is executed by roundir^ with 1/2. In order to prevent the generation of accumulated en-ors due to requan- 
tization, it is the most preferable that the quantization in the system B is also set to 1/2, to obtain a symmetry coded 
content. The frame rate conversion, requantization of DCT coefficient and picture size conversion are processing all to 
execute '^requantization ', in the broad sense, of moving pictures. For the requantization, it is preferable to operate coder 
303 with the system B depending on decoder 301 with the system A in FIG.3. 

45 [0032] As described above, in order to execute the rate control, it is preferable to operate coder 303 with the system 
B independently of decoder 301 to enable the control of requantization. while observing the loaded content in output 
buffer 304. On the other hand, in order to reduce image quality deterioration by the broad-sense requantization, it is 
preferable to operate coder 303 with the system B depending on decoder 301 with the system A. However, the conven- 
tional techniques concerning the transcoder is developed from a point of view to improve the computation efficiency by 

50 using the side information, for example, recoding by motion vector scaling, and a technique is not disclosed ttiat 
achieves both rate control and suppression of image quality deterioration due to requantzation. 

SUMMARY OF THE INVENTION 

55 [0033] In view of the forgoing, an object of the present invention is to provide a method and apparatus for perform- 
ing a rate control while suppressing image quality deterioration in transforming a moving picture coding system. 
[0034] A first aspect of the present invention is a method and apparatus for transforming, sequentially from a head 
of data, a first data sequence generated by a first moving picture coding system comprised of an irtra-frame coding 
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mode and inter-frame coding mode to a second data sequence generated by a second rTtoving picture coding system 
comprised of the intra-trame coding mode and inter-frame coding mode, and the method and apparatus 

1 . read data of a frame from the first data sequence, and further preread a coding mode of a successive frame : and 
5 2. decides whether the present frame should be coding or not for decrease a generated code amount, correspond- 
ing to a generated code amount of the second data sequence transformed to the second moving picture coding 
system in the case where the preread coding mode of the successive frame is the intra-frame coding mode. Then 
the data coded by the intra-frame coding mode existing in the first data sequence is preferentially transformed to 
the second data sequence. 

10 

[0035] According to such method arxl apparatus, ft is possible to perform stable coding which does not cause the 
overtlow in coding an T frame, by prereading the coding mode of the successive frame, and controlling the coded con- 
tent of the present frame con^esponding the coding mode of the successive frame and the coded content generated in 
the system transformation. 

15 [0036] A second aspect of the present Invention is a method and apparatus for transforming a first data sequence 
generated by a first moving picture coding system to a second data sequence generated by a second moving picture 
coding system, while transforming a frame or a picture portion obtained by dividing a frame on a coding-unit basis 
sequentially from a head of data, and the apparatus and method 

20 1 record a code amount of the coding-unit in reading data of the coding-unit from the first data sequence, and 

2. set a target value of the generated code anrx>unt of the second data sequence at a value obtained by multiplying 
the recorded code amount by a predetermined factor in transforming the data of the coding-unit to that of the sec- 
ond moving picture coding system, and then control a rate so that a ratio of code amounts, on a coding-unit Ijasis, 
of data composing said first data sequence comes close to a ratio of code amounts, on the coding-unit basis, of 

£5 data composing said second data sequence. 



55 



[0037] According such method and apparatus, it is possible to perform the receding faithful to original rate control, 
and to suppress image quality deterioration due to errors accumulated by requantization. by recoitling the code amount 
of a frame of original image data, and setting the target value of the generated code amount of the second data 
30 sequence at the value obtained by multiplying the recorded code amount by the predetermined factor in transforming 
the data in the second moving picture coding system. 

[0038] A third aspect of the present invention is a method and apparatus for transforming, sequentially from a head 
of data, a first data sequence generated by a first moving picture coding system that switches an intra-frame coding 
mode and iniiir-frame coding mode on a Wock-by-block basis to a second data sequence generated by a second mov- 
ing picture coding system that switches the intra-frame coding mode and inter-frame coding mode on the Wock-by-block 
basis, and the method and apparatus select the intra-frame coding mode more In the second moving picture coding 
system than in the first moving picture coding system in the case where a generated code amount of the second data 
sequence does not reach a target value. 

[0039] According to such method and apparatus, the capacity of an output buffer is adjusted by inserting the intra- 
frame coding mode when the capacity left in the output buffer is relatively large. It Is thus possible to perform rate control 
without changing quantization characteristics, and to suppress Image quality deterioration caused by requantization. 
[0040] A fourth aspect of the present invention Is a method and apparatus fa transforming, sequentially from a 
head of data, a first data sequence generated by a first moving picture coding system that switches an intra-frame cod- 
ing mode and tnter-frame coding mode on a Wock-by-blod^ basis to a second data sequence generated by a second 
moving picture coding system that switches the intra-frame coding mode and the inter-frame coding nwde on the block- 
by-block basis, and the method and apparatus select the inter-frame coding mode more in the second moving picture 
coding system than m the first rTX)ving picture coding system in the case where a generated code amount of the second 
data sequence exceeds a target value. 

[0041] Accoiding fo such method and apparatus, the capacity of an output buffer is adjusted by inserting the inter- 
fiame coding mode when the capadly left in the output buffer is relatively small, tt is thus possible to perform rate control 
witiiout changing quantization characteristics, and to suppress image quality deterioration caused by requami2ation 
[0042] A fifth aspect of the present invention is a method and apparatus tor sequentially transforming a first data 
sequence generated by a first unlossless moving picture coding system with an information loss caused by quantization 
to a second data sequence caused by a second untossless moving picture coding system with an data loss generated 
by quantization, and the method and apparatus: 



35 
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1 . recoid a quantization scale in reading data from the first data sequence; and 

2. change a quantization scale to Integral times the acquired quantization scale in adjusting the generated code 
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amount of the second data sequence. 

[0043] According to such method and apparatus, it is possible to suppress image quality deterioration caused by 
requantization. by changing the quantization scale by integral times when the rate control is performed by changing the 
f quantization scale. 

BRIEf DESCRIPTION OF THE DRAWINGS 

[0044] The above and other objects and features of the invention will appear more fully hereinafter from a consid* 
10 eration of the following description taken in connection with the aooompanying drawing wherein one example is illus- 
trated by way of example, in which; 

FIG. 1 illustrates a conceptual diagram of a transcoder; 

FIG. 2 is a diagram illustrating an exemplary conventional transcoder; 
15 FIG. 3 illustrates a conceptual diagram showing subjects for the transcoder; 

FIG,4 is a diagram illustrating an image data structure in the H.261 standard; 

FIG.5 is a diagram illustrating a data structure in the H.261 standard; 

FIG.6 is a diagram illustrating an image data structure in the MPEG-4 visual simple profile; 

FIG 7 Is a diagram illustrating a data structure in the MPEG-4 visual simple profile; 
30 FIG 8 is a diagram illustrating intermediate data in a transcoder; 

FIG.9 is a flowchart for the entire process of the transcoder: 

FIG. 10 is a flowchart to control tntra*inter coding mode in a transformation of H.261 to MPEG-4; 
F1G.1 1 is a flowchart to change coding data on a macroblock-by-macroblock basis for rate control in the transfor- 
mation of H.261 to MPEG-4: 
25 FIG 12 is a flowchart to control intra-inter coding mode in a transformation of MPEG-4 to H.261 ; 

FIG. 13 is a flowchart to change coding data on a macroblock-by-macrob(ocK basis for rate control in the transfor- 
mation of MPEG-4 to H.261 ; 

FIG. 14 is a conceptual diagram of a transcoder of the present invention; 
FIG.15 is a diagram illustrating the transcoder from H.261 to MPEG4; and 
30 FIG.16 is a diagram illustrating the transcoder from MPEG-4 to H,261 . 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

[0045] The embodiments describe the case that a bit-stream coded in the moving picture coding system based on 

35 ITU-T Recommendation H.216 is transformed to the bit-stream in the moving picture coding system teased on the 
MPEG-4 standard, and another case that the opposite transformation is perlormed. Both systems are representative 
coding systems performed based on the MC-DCT system, and the details thereof are respectively described in an ITU- 
T Recommendatfon H.261 document (H.261 Recommendation. LINE TRANSMISSION OF NON-TELEPHONE SIG- 
NALS 03/1993) and in an ISO standardization document (Document Number ISO/IEC JTC1/SC29/WG1 1 HZSOZ Doc- 

40 ument Name INFORMATION TECHNOLOGY-GENERIC CODING OF AUDIO-VISUAL OBJECTS Part 2:Visual 
ISO/IEC 14496-2. published 10/1998. Further, used as a reference of operations of H.261 coder thai is not specified in 
the standardization is CCITT (currently ITU-T) SGI 5 WorKing Party 15/4. Specialists Group on Coding ibr Visual 
Telephony Document 525. Description of Ref. Model 8 (RMS), June, 1989. 
[0046] The data structure in the H.261 standard is first explained. 

45 [0047] FIG.4 illustrates an image data structure in the H.261 standard. An image to be code is called QCIF (Quarter 
Common Interlace Format), and is assumed to have 176 pixels in the horirontal direction and 144 pixels in the vertical 
direction. /\lso in the H.261 standard, the image is divided to macro blocte each comprised of 16>< 16 pixels. The motion 
compensation is performed on a macroWock-by-macroblok basis, while the DCT coding is performed on a DCTWock- 
by-DCTWock basis. The DCT block is comprised of 8x8 pixels. Since 4 DCT blocks are necessary for luminance, and 

so 2 DCT btocks are necessary for chrominance ( 1 for Cb or Cr) because the resdutfon therefor is half that for luminance 
in the horizontal and vertical cfirections. the macro block is composed of 6 DCT btocks. A block conprised of three lines 
of macro blocks is called GOB (Group of Block). 

[0048] F1G.5 illustrates the data structure coded based on the H.26r standard. The explanation is performed while 
separating the bit-stream to four layers. The bit-stream is composed of repeated pictures (frames), and has PSC (Pic- 
55 ture Start Code) at a first portion followed by TR (Temporal Reference), and then PTYPE (Picture Type: Type data). In 
H.261. PTYPE is indicative of a picture size and reproduction mode, and not indicative of information on whether the 
frame is subjected to intra-frame coding (intra-coding) or inter-frame coding (inter-coding). Thereafter. GOB layeis are 
repeated (three times in the case of QCIF). 
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(0049] The head of GOB layer is started by GBSC (GOB Start Code). GN (GOB Number) succeeds GBSC, and 
then GQUANT (Quantization Characteristic Data) is transmitted. In H.261, the quantization of DOT coefficients is per- 
formed with a quantization scale represented by one of indices of 1 to 31 in the inter-coding, while a single type of such 
quantization corresponding to index 8 is performed in the intra-coding. 
5 [0050] "The quantization scale of DCT coefficient for the GOB is instructed with GQUANT Macro block data is 
repeated at an end portion of the GOB layer. The macro block data is started with MBA (Macro Block Address), which 
indicates a relative position of macro block containing valid code. In the MC-DCT coding, an image is reproduced in a 
stiti region without transmitting a motion vecta and also DCT coefficient. 

[0051] In such a region, it is not necessary to transmit data of macro blocks, which is called macro block skip, and 
10 therefore MBA is needed. MTYPE (Type data) is used to instruct whether the macro block is inter-frame coded or intra- 
frame coded. In the MC-DCT coding except H.261 , it is general that the switching between intra-coding and inter-coding 
is performed on a macroblock-by-macroblcok basis in addition to the switching between intra-coding and tnter-coding 
on a frame-by-frame basis. 

[0052] Further. MTYPE includes information on whether the maao block is subjected to loop filter. The loop filter is 
75 specifk; processing in H.261 (not included in other standards) to subject a motion-compensated predicted image to fil- 
tering by local -averaging. Since the predictive efficiency is improved in some cases, the loop filtering is adaptively used. 
MQUANT (Quantization Characteristics) is indicative of the quantization scale of DCT coeffident for the GOB deter- 
mined with OOUANT. arxi is transmitted in the case where the quantization scale is needed to be changed on a mac- 
roblock-by-macroblok basis. MVD (Motion Vector Data) is indicative of a motion vector used for motion conpensation. 
20 CBP (Coded Block Pattern) is indicative of a signifk»nt block pattern. 

[0053] Among total 6 DCT blocks, it is not necessary to transmit a block of which the quantized DCT coefficients 
show all zero. Therefore, the DCT coefficients are transmitted while designating only a block with non-zero coefficients 
with CBR 

[0054] The MPEG-4 standard is next explained. 
2S [0055] MPEG-4 has a variety of functions called profiles used depending on applicatkwis. The embodiments use a 
simple profile that is the simplest one as a subject of the transformation. 

[0056] Fiae illustrates an image data structure in MPEG-4. In H.261 . the picture size is defined as a OCIF picture 
and CIF picture with horizontal and vertical sizes respectively twice those of CIF (Common Interface Format) picture. In 
MPEG4. however, the picture size is arbitrary, and not limited to even a number multiplied by 16. Further, in MPEG-4, 
30 the aspect ratio of a pixel (ratio of a vertical line to a horizontal line when the pixel is considered to be a rectangle) is 

also arbitrary. Such a ratio is 4:3 in H.261 . 

[0057] Therefore, picture sizes to be handled hereinafter are all matched with those specified In H.261 to sinplify 
the explanation. 

(OOSq A structure called Video Packet is defined in MPEG4 instead of GOB in H.261 . On the contrary to that GOB 
35 is obtained by dividing an image to fixed redan^es. a starting point of the Vkjeo Packet is arbitrary on a macrobiock- 
by-maaoblock basis. The other structures of DCT block are almost the same as in H.261 , and omitted in FIG.6. 
[0059] In MPEG-4, an image corresponding to a frame or picture is called Video Object Plane (hereinafter referred 

toasVOP). 

[0060] A bit-stream in MPEG4 starts with VSC (VOP start code) followed by VTYPE (vop coding type) Indicative of 
40 informatkan on whether the frame is intra-frame coding (intra-coding) a inter-frame coding (inter-coded). In H.261, TR 
(Temporal Reference) is indicative of a frame number as a time indication, however, in MPEG4. a passing time from a 
reference frame is directly Instructed with MTB (module time base) with the order of a second, and with VTI (vop time 
increment) with the order of less-than-seoond, of which the detailed explanation is described in the abwe reference and 
omitted herein. VQAUNT is indicative of quantizatwn characteristic data, corresponding to GQUANT in H.261 . to des- 
4$ ignate a quantization scale in the entire image. RSM (Resync Marke) is inserted before a Video Packet header to per- 
form resynchronizatioh promptty for transmission error. The VkJeo Packet header contains data concerning VOP 
needed after the resynchronizatk>n. 

[0061 ] The macro tshck data starts from NCD (Not Coded, invalid flag). In H.261 . an invalkJ macro block is skipped 
by using a relative address to next valM macro block with MBA, however, in MPEG4. the invalid macro block is repre- 
so sented by a flag of 1 bit. MCBPC (macrobtock type and the coded block pattern for chrominance) is used to perform the 
switching between intra-coding and inter-coding in the same way as MTYPE 

[0062] In addition, since MPEG-4 does not include the loop filter. MCBPC does not include an indication for the k)op 
filter. Meanwhile. MCBPC is indicative of valid/invalid pattern of DCT btock of a signal. In other words. MCBPC includes 
data concerning chrominance signal among data of CBP in H.261 . With respect to the valid/invafid pattern of luminance 
55 DCT blocks, a pattern of kiminance four blocks composing macro ttocks is represented with CBPY (luminance signifi- 
cant block pattern). 

[00631 DQUANT is for use in changing the quantization scale of DCT coefficients on a macroWock-by-macrobk)k 
basis. An increment or decrement value is designated in the range of 2 to +2, which is different from MQUANT. MVD 
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(Motion Vector Data) is indicative of a motion vector used in motion compensation. The accuracy in H.261 is of an inte- 
gef-number-of-pixel tiasis, however the accuracy in MPEG-4 is of a half-pixel (0.5 pix^) basis. The structure of DCT 
coefficient block is almost the same as in H.26t . 

[00641 As desaibed above. MPEG-4 with the simplest structure shares the basic structure of the MC-DCT with 
5 H.261 . and although the data structure of MPEG-4 is different in representation way (coding description) from that of 
H.261, there is a lot of conpatibility in both data. The considerable differences between H.261 and MPEG4 in trans- 
forming the coding system are as follows: 

Motion compensation 

10 

[0065] 

H.261 : Integer-accuracy 
and loop filter 
15 MPE04 : hatf-pixel accuracy 

A search range can ba changed by scaling called F value: and there Is a mode in which four motion vectors 
are present per a macro block. 

DCT coefficient quantization 

[0066] 

Linear quantization with the same quantization scale in H.261 and MPEG4 

25 in addition, with respect to a direct current component in an intra-coding mode. MPEG4 has a non-tinear quantization 
mode, while the intra-coding in H.261 fixes a quantization index to 8. 

[0067] From the differences as described above, a transcoder cannot have a configuration to transfer OCT coeffi- 
cient directly, and therefore has a configuration, as ilustrated in FIG. 3. where in transforming data based on the system 
A (H.261 or MPEG4) to data based on the system B (MPEG4 or H.261). the sy$tem-A-coded data Is once decoded and 
30 the decoded image is recoded through frame memory 302. 

[0068] In this case, as the side informatkm. intermediate data for the transcoder illustrated in FIG.8 is considered. 
[0069] FIG.8 also illustrates storage sections in the memory in which respective data is stored, corresponding to an 
embodiment descrit^ed later. 

[0070] The meaning of each data is e^^lained below. As can be seen from the data structure as described above. 
3S the data can be used as the intermediate data. 

• Next Frame Coding Mode NPTYPE^P'. 'P*. 

Obtain tiy prereading during decoding in the system A. VTYPE in MPEG-4. and U: unfixed in H.261 . 

• Present Frame Coded Content Pcontnet (unit:tt)its) Obtain by decoding one frame in the system A 

40 When recoding is performed after one frame is completely decoded, the content is equivalent to a code amount for 
one frame. When recoding starts in the middle of decoding of an original image, the content is equivalent to a code 
amount obtained by the time the decoding is suspended after starting on the frame. 

• Present Frame Coding Mode PTYPE=rr. P] 

*r represents intra-coding, and 'P' represents inter-coding. In H.261. T means afl macro blocks are intra*coded. and 
45 'P' means the other cases except the above. This is determined from PREDi.j described later. 

Present Frame Number TR (Integer number) 

In MPEG-4. obtained from MTB and VTI. 
' Valid/lnvalkl flag CDij- [0. 1 . 'Ul 

This flag indicates valid: 0 or invalkJ: 1 of a macro block, i and j respectively represent horizontal and vertical posi- 
50 tions of the macro block 'LT represents unfixed'. For example, the case where a P picture in the system A is 

recoded to obtain an I picture in the system B is represented with 'unfixed'. 
' Block Valid/Invalid flag CBPi j.ks:[0, 1 . *U1 

This flag indicates valid or invalkf of a DCT block. In MPEG^. determined by MCBPC and CBPY. Since Yx4. Crxl 

and Cbxl , k adopts values of 0 to 5. 
55 • Quantization Scale QUANTi.j = (1 . ^. 31 . 'Ul 

This is an index indicative of a quantization scale on a macrobk>ck-by-maaoblock tiasis. 

• Coding mode MTYPEi.j = {\\ V\ Ul 

This represents a coding nxxfe of intra or inter on a maaoblock-by-maaobkxk basis. 'U' represents 'unfixed*. 
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• Motion Vector (MVXi.j, MVYI.j) 

Value is (-1 5. 15. U] Horizontal and vertical absolute values of a motion vector are represented with inte- 
ger-accuracy to match with H.261 that employs the integer-accuracy. 
' Intra Period PERlODi.j = integer number of [0.99] 
5 In the MC-DCT system, accuracy in inter-frame DCT computation Is accumulated, causing a mismatch of the com- 
putation between coding and decoding. 

To cope with it, intra-coding on a macro block should be performed within a 1 32 -coded-frame period. 

This operation is called intra-refreshing. PERIOD is a counter to perform the intra ref reshing periodicatiy. Default is 

0. 

TO • Moving Region flag MOVi, j = [0, 1 , 'Ul 

This flag indicates whether the macro block is contained in a moving region. 'V is indicative of a moving region. In 
this emtxxjiment, an absolute value of either of elements (MVXij, MVYiJ) being equal to or more than 1 is indicative 
of a moving region. 

15 [0071] The data structures of H.261 and MPEG4 are as described above. The flowchart comnfX)n to the first 
embodiment and second emtjodiment is next explained with FIG.9. 

[0072] First, all i and j of PERIODi. j are set at 0 by initialization. This daUi concerns the intra-inter coding control 
on a macroblock-by-macroblock basis. 

[0073] Next, according to the steps of reconstruction of the system-A image (H.261 or MPEG-4) and of generation 
20 of Intermediate data, a reproduced image and intermediate data of NPTYPE. Pcontent, PTYPE. TR, CDi.j. CBPi,j,k, 
QUANTij. MTYPEiJ. (MVXi.j. MVYi.j). and MOVi.j is generated. 

[0074] Herein, the t^sic prirtciple of the transcoder for all the embodiments are as follows: 
[0075] Basic principle 1 : Among the side information generated in the system-A decoding. PTYPE, TR, CDi.j. 
CBPi j.K. QUANTi.j. and MTYPEi,j are basically aH shifted to the system-B coding mode to use. It is thus possible to pre- 
ss vent the accumulated image quality deterioratk>n due to requantization. 

[0076] In additkm. some of the skje information generated in the system-A decoding 1$ changed for the rate control. 
The method of the change is descried later. 

[0077] Basic principle 2: Motion vector data (MVXi.j and MVYi.j) is used as reference data in the system-B recoding. 
In other ¥vords. when the value of the motion vector is fixed, re-searching a position that minimizes the differential 
30 between macro blocks as a motion vector is performed in the vidnity of the fixed value, while the search is performed 
from (0,0) when 'U'. 

[0078] In FIQ.9. after the intermediate data is generated, the flow goes to the branching. 

[0079] When the coding mode of the present frame is the Inter-coding mode, the coding mode of ttie next frame is 

the intra-coding mode, and the txiffer loaded code anKSunt (Bcontent in the figure) is as follows: 

35 

Pcontem( Accumulated code amount of the frame) > half the buffer capacity. 

the present input frame is abandoned, the coding thereof is discontinued, and the next frame is intra-coded. 
[0060] Further, the same processing as described above is performed in the case where a decoding stie instructs 
40 to forcedly imra-code the next frame. UVhen an error oocurs. the decoding skSe instructs to forcedly intra-code the next 
frame. 

[0081] bi the MC-DCT coding, the intra-coded frame, called 1' picture, is important. It is because frames succeeding 
the r picture cannot be decoded without the T picture. Meanwhile, when the capacity left in the output buffer is relatively 
small, the execution of recoding according to the above-mentioned basic principle 1 causes a risk that data overflows 
45 the output buffer in recoding the T pk^ture. When the T picture is not coded due to the overt tew. the image quality dete- 
riorates. 

[0082] Then, NPTYPE of the successive frame succeeding the present irpul frame is preread. and the coding 
processing in the system B Is switched corresponding to NPTYPE of the successive frame arxf a cunent tjuffer loaded 
code amount (Bcontent). In other words, when the successive frame is the T prcture, and there is a possibility that data 
so overflows the output buffer when the T picture is recoded. the present input frame ('P* picture) is abandoned to ensure 
the capacity of the output buffer for the '1' picture that Is the successive frame to be recoded This concept is shown in 
FIG.9. 

[0063] In addition, in H.261 . since a mode Indication Indicative of intra or inter coding is not at a head of a frame, 
the conditk>nal branching in FKji.9 is applicable only to the transformation from MPEG-4 to H.261 . 
55 [0084] In FIG.9. the flow is no' in the conditional branching (always no* in the transformation from H.261 to MPEG- 
4). the flow goes to intra-inter coding mode control. With respect to the processing performed after this control, a first 
embodiment describes the transfbrmatwn method from H.261 to MPEG-4, and a second embodiment describes the 
transtbrmation method from MPEG-4 to H.261 . 
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[0085] In the first embodiment, the transformation based on flowcharts illustrated in FIGS.9 to 1 1 is performed. 
Among process steps enclosed with bold lines in F1G.9. the intra-inter coding mode control (SI ) is performed according 
to the flowchart illustrated in FIG.1 0. and change of coding data on a macroblock-by-maaoblock basis for the rate con- 
trol (S2) is performed according to the flowchart illustrated in FIG. 1 1 . 
5 [0086] Herein, it is assumed that, as conditions for the rate control, a coding rate of H.261 is 64 tops, a coding rate 
of r^PEG-4 is also 64 kbps. and that a buffer size of the output buffer is 6 4 kbit. 

[0087] In the intra-inter coding nxxle control illustrated in FIG.10. when the H.261 data sequence is transformed to 
the MPEG-4 data sequence, the predetermined nunrtoer (3 in this embodiment) of macro blocks are selected from 
macro blocks belonging a moving region in descending order of refreshing period, and the coding mode of the selected 

10 macro blocks are forcedly changed to the intra-coding mode. 

[0088] According to the processing as described above, since intra-refreshing is performed on the macro blocks 
mainly t>elonging to the moving region, the error -resistance characteristic of the MPEG-4 bit-stream is improved. It is 
because when a transmission error occurs in a still picture regton, the error is recovered by copying the result of the 
previous frame, causing image quality deterioration In the moving region. 

IS [0089] FIQ.1 1 illustrates the processing steps for recoding the macro blocks judged as the inter-coding mode. AS 
a motion prediction, the processing shown in the basic principle 2 of the transcoder ts performed. 
[0090] At this stage. VAR and VAROR are computed. In addition. VAR is a mean square of motion compensated 
irrter-t)k>ck differential pixels (luminance variance), and indteates power of inter-frame differential signal, while VAROR 
is a mean square of input image intra-block pixels (luminance variance), and indicates power of intra-frame signal. 

20 [0091] RM8 (described in the previously-described cited reference) typical as a model of H.261 coder determines 
whether the coding mode of a macro block is inter or intra coding mode using the VAR and VAROR. Specifically, the 
inter-coding is performed when VAR < 64, i.e., a power level of the inter-frame differential signal is absolutely small, or 
VAR < VAROR. i.e.. the power level of the inter-frame differential signal is smaller than the power level of the intra-frame 
signal. 

2S [0092] In the inter-coding, the rate control is performed to adjust a generated code amount so that the buffer loaded 
code amount (Bcontent) comes close to a scheduled code amount. In this embodiment, the scheduled code amount is 
computed based on the following equation : 

Scheduled code amount= Pcontent x (MPEG-4 coding rate/H.261 coding rate) x 
the nun[i>er of currently processed macro blocks/the total number of macro blocks 

[0093] In this embodiment, the coding rates are both 64 kbps. (MPE(j4 coding rate/H.26l coding rate) is 1 (>=1). 
[0094] Thus, since the scheduled code anrxsunt (in other words, target coded content) is computed based on Peon- 

35 tent, it is possible to achieve originally performed rate control, while maintaining the quant izatk)n control in H.261 as 
much as possible. For example, the rate control is performed so tfiat a ratio of code amounts on a coding-unit basis of 
data composing the systenvA data secpence comes dose to a ratio of code amounts on the coding-unit basis of data 
composing the system-B data sequence. As a result, the concept in constructing the systenrvA data sequence is main- 
tained in the systenrvB data sequence after the trarsformation. 

40 (0095] In addition, coefficient "r" that is a factor to be multipiied VAR is calculated based on the following equation: 

r s max ( 1 .0. scheduled code amount / generated code amount) 

[0096] Therefore, VAR is more than 1 when the generated code amount is less than the scheduled code amount. 
45 Accoidingly, VAR»VAR*r is set to iiKrease VAR in the case where the capacity left in the output buffer is relatively larg 
(the generated code amount is less than the scheduled code amount), so that intra-coding modes are more selected, 
thus controlling the mode. 

[0097] In general coder control, a quantization scale is decreased to improve the image quality when a bit rate is 
relatively high. In the systerrvtransformation-coding according to the present invention, however, as desaibed previ- 

so ously. since it is preferable not to change quantization characteristics as possible, the number of frames of the intra-cod- 
ing mode (I picture) is increased with the change of quantization scale minimized. This processing improves the error- 
resistance characteristic for transmission failure such as packet loss. Generally, since it is considered that the coding 
efficiency of MPEG-4 is higher than that of H.261. in the transformation with the same coding rates, the above- 
described advantage is obtained by controlling to adopt more intra-coding modes within a range of the capacity left in 

55 the output buffer. 

[0098] In addition, the final step in the f bwchart illustrated in FIG. 1 1 is the control for OUANTi. j. In RMS. the quan- 
tization scale is obtained in the following equation in tfie case of 64 kbps: 
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Quantization scale s2xint (txiffer loaded code amount [bit]/200 + 2 

[0099] Controlling the quantization scale based on the above equation achieves the feedback control that the quan- 
tization scale is increased when the buffer loaded code amount is inaeased. thus decreasing the generated code 
amount. 

(01 00] In this embodiment, in consideration of the relationship between the accumulation of quantization errors and 
generated bit contents, the quantization scale is changed as follows: 

buffer loaded code anfiount > 70% of buffer capacity quantization scale = QUANHj x 2 

buffer loaded code amount > 80% of buffer capacity quantization scale » QUANTij x 3 

buffer loaded code amount > 90% of buffer capacity quantization scale » QUANTiJ x 4 

15 [01 01 J In addition, in MPEG-4, since a value of QUAffTI, j is only allowed to be changed by maximum 2 in neigh- 
boring macro blocks, the change scale is limited to maximum 2. 

[0102] Thus, the coding mode is first controlled to make the buffer loaded code amount close to the target coded 
content, and when it is further necessary to change the quantization characteristic (quantization scale), the quantization 
scale in the system B is set to be integer times the quantization scale in the system A. 

20 [0103] The first embodiment, as described above, achieves an example of methocte for perlbrming the rate control, 
wnile maintaining the quantization characteristics performed before the system is transformed. 
[0104] In addition, when the capacity left in the output buffer is relatively large, the number of macro blocks to be 
intra-coded is increased by redefining the value of VAR, according to this embodiment. However, it may be also possible 
to increase or deaease a value N of intra-refreshing of a macro block belonging to a moving region. 

25 [01 05] The second embodiment is next described. 

[0106] The second embodiment describes tfie transformation method from MPEG-4 to H.261 . The tianstormation 
operations in this entoodiment are performed based on ftowcharts illustrated in FIGS.9. 1 2 and 13. 
[0107] Among processing steps enclosed with bold lines, the intra-inter coding mode control is performed accord- 
ing to the flowchart in FIG.12. and the change of coding data on a macrobtock-by-macrobkxdt for the rate control is per- 

30 formed according to the flowchart in FIG. 13. 

[0108] The difference of tNs embodiment from the first embodiment is mainly explained to simplify the explanation. 
[0109] Herein, it is assumed that macro blocks more than needed are intra-coded to Inprove the error resistance 
although the coding effk;iency of MPEG-4 is higher than that of H.261 . 

[0110] in the control for the intra-inter coding mode illustrated in FIG. 12. coding modes of intra-coded macro blocks 
35 are set at 'U' (unfixed) except macro block with the maximum PERIODi.j. or macro bk>ck with PERIODi.j exceeding the 
total number of maao blocks (99) Thus, even in the case where the coding mode of the present frame is the inter-frame 
coding mode, minimum intra-coded macro btocks are only left, and coding modes of other intra-coded macro blocks are 
set at U (unfixed). As a result, the case occurs that the other intra-coded maao blocks are inter-coded aoain in next 
step (FIG. 13). 

40 [01 11] In the case where data is transformed from the system B of which the coding eff iderKy is high to the system 
A of Which the coding efficiency is relatively low, when 1 pictures (intra-coded pictures) contained in the system-B data 
sequence B are all transformed to data In the system-Adata sequence, there is a possbility that data oveiftows the out- 
put buffer because the code amount of an I picture is larger than that of a P picture (inter-coded picture). In this entood- 
iment. the nurrter of macro bkjcks to be intra-coded is decreased to prevent the overflow in the buffer without 

45 controlling the quantization scale. In other words, the nun*er of macro blocks to be inter-coded is relatively increased. 
[0112] The judgement of intra-inter coding illustrated in FIG.13 is a general judgement method with VAR and 
VAROR described in RM8. QUANTi.j control that is the final step in FIG.1 3 is the same as in the first embodiment and 
the explanation thereof is omitted. 

[0113] According to the second embodiment, in the system transformation to H.261 of which the coding effk:iency 
so is generally considered to be less than that of MPEG.4. intra-coded maao blocks are changed to inter-coded macro 
blocks while changing the cocftng mode, thereby making it possible to prevent the overt kyw in the buffer without control- 
ling the quanti2ation scale tor other macro btocks. 

(0114J Tww) embodiments for an image ooding transformation apparatus are next desaibed. FIG 14 illustrates a 
conceptual diagram of a transcoder common to a third embodiment and fourth embodiment and the method in FIG 9 
55 is achieved therein. 

[0115] Intermediate data described in FIG.8 is stored in frame coding mode memory 406. motion vector memory 
407. macro block coding memory 408 and rate control information memory 409. Coder control section 405 achieves the 
control described in FIG.9. In response to the control signal, frame coding mode changing section 410. and macro block 
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coding mode changing section 41 1 each pertorms the change. 

[01161 FIG.14 illustrates a configuration where data of PTYPE. TR. CDi j. CBPi.j.k, QUANTi.j. and MTYPEi.j is pro- 
vided to a coder with the system B without being changed unless coder controller 405 transmits a control signal. 
[0117] The details of F1G.14 are illustrated in FtG.l5. which illustrates an apparatus corresponding to the method 

£ of the first embodiment as a third embodiment. In FIG.1 5. 501 is a variable length decoding section. 502 is an inverse 
quantization section that performs inverse quantization. 503 is an inverse OCT section that performs inverse DCT 
processing, 504 is an adder, 505 is a frame memory, 506 is a motion compensation section that performs processing 
for motion compensation, and 507 is a loop filter, thus composing an H.261 decoder. A decoded image is provided to a 
MPEG-4 coder through frame memory 505. 

10 [0118] 508 is a subtracter. 509 Is a DCT section that performs DCT calculation, 510 is a quantization section that 
quantizes DCT coefficients. 513 is an adder. 514 is a frame memory, 515 is a motion prediction and motion compensa- 
tion section that pertorms rrotion prediction and motion compensation, 516 is a variable length coding section, and 51 7 
is an output buffer, thus composing a MPEG-4 coder. 

[01 1 9] 51 8 is a MP EG-4 rate control section . and achieves the control desalbed in FIGS. 9. 1 0 and 1 1 . Intermediate 
15 data is stored in rate control data memory 519. macro block coding mode memory 520. and frame coding mode mem- 
ory 521 . The MPEG-4 coder is controlled, while receiving the data of PTYPE. TR, CDi.j. CBPi, i. k, QUANTi.j and MTY- 
PEi, j among ttie intermediate data. More specifically, block mo6e changing section 522 changes the coding mode of a 
macro block, and the intra-inter mode changing section controls the predictive coding based on the data of PTYPE and 
MTYPE. 

20 [0120] In addition, mode data is multiplexed in variable length coding section 516 to be output to an output buffer, 
which is not shown in the figure to be sinrplif led. 
[01 21 } A fourth embodiment is next explained with FIG. 1 6. 

[01 22] An apparatus of the fourth embodiment performs the transformation from MPEG-4 to H.261 . inversely to the 
apparatus of the third embodiment. In FIG 16, 601 is a variable length decocfing section. 602 Is an inverse quantization 
25 section, 603 is an inverse DCT section. 604 ts an adder. 605 is a frame memory, and 606 is a motion oompensation 
section, thus composing a MPEG-4 decoder. 

[0123] A decoded image is provided to an H.261 coder through frame memory 605. 

[0124] 607 is a subtracter. 608 is a DCT sectk)n. 609 is a quantization sectkxi. 610 is an inverse quantization sec- 

tfon, 611 is an inverse quantization section. 612 is an adder. 613 is a frame memory. 614 Is a motion predictfon and 
30 motion compensatfon sectfon, 615 is a toop filter. 61 6 is a variable length coding section, and 61 7 is an output buffer. 

thus composing the H.261 coder. 618 is an H.261 rate control section, and achieves the control described in FIGS.9. 

12 and 13. Intermediate data is stored in rate control data memory6l9. macro block coding mode memory 620, and 

frame coding mode memory 621 . The H.261 coder is controlled, while receiving the data of PTYPE. TR. CDi,]. CBPi.j.k. 

QUANTi.j and MTYPEi.j among the intermediate data. More specifically, block mode changing section 622 changes the 
35 coding rrxxie of a macro block, and the intra-inter mode changing section controls the predfotive coding based on the 

data of PTYPE and MTYPE. In addition, mode data is multiplexed in variable length coding section 623 to be output to 

an output buffer, which is not shown in the figure to be simplified. 

[0125] Two emkxxliments for the image coding transtormatfon methods as described in claims 6 to 10 are as 
desaibed above. 

40 [0126] TTie scope o# the present invention includes computer program products that are recording media in which 
a program, loadable with a computer, for achieving the present invention is stored. The recording media include discs 
such as a ffoppy disc, optical disc. CD-ROM and magnetic disc. ROM. RAM, ERROM. EEPROM. and magnetic or opti- 
cal card. The present invention is, however, not to limited to such media in particularly. Further, it may be possible to 
record the program in a recoiding medium to transfer to a worldwide terminal, or forward the program (distribute with 

45 encryption) via a communication channel such as the intemet. thereby achieving the present invention in a computer 
and portable information terminal. 

[0127] The present invention is not limited to the above desaibed embodiments, and variois variations and modi- 
fications may be possible without departing from the scope of the present invention. 

[0128] This application Is based on the Japanese Patent Application No.HEI1 1-047613 filed on February 25. 1999, 
so entire content of which is expressly incorporated by reference herein. 

Claims 

1 . A method for transforming a first data sequence generated by a first moving picture coding system having an intra- 
55 frame coding mode and an imer-frame coding mode to a second data sequence generated by a second moving 
picture coding system having an intra-frame coding mode and an inter-frame coding mode, comprising: 

prereading a coding mode of a successive frame succeeding a present frame from said first data sequence: 
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judging whether or not a preread coding mode of said successive frame is the intra-frame coding mode, and 
determining whether or not to code said present frame by said second moving picture coding system corre- 
sponding to a generated code amount of said second data sequence in the case where the coding nrode of 
said successive frame is the intra-frame coding mode, wherein data coded by the imra-frame coding mode 
5 existing in said first data sequence is preferential! y transformed to said second data sequence. 

2. The method according to claim 1 , further comprising: 

abandoning said present frame to skip to said successive frame when said generated code amount of said 
10 second data sequence has been exceed a predetermined value in the case where the coding mode of said 

successive frame is the intra-frame coding mode. 

3. The method according to claim 2. further comprising: 

ts writing said second data sequence generated by said second moving picture coding system in an output 

buffer(404); 

wherein as said generated code amount of said second data sequence, a buffer loaded code anfx>unt of said 
output buffer(404) is used. 

20 4. The method according to claim 1 to claim 3. further comprising: 

recording a code amount on a coding-unit basis in reading data on the coding-unit basis from said first data 
sequence: 

determining a target value of said ger>erated code amount of said second data sequence on the coding-unit 
25 basis, said target value being obtained by multiplying a recorded code amount by a factor; and 

pefforming a rate control so that said generated code amount of said second data sequence comes dose to 
said target value in generating said second data sequence from said data on the coding-unit basis by said sec- 
ond moving picture coding system, 

wherein a ratio of code amounts, on the coding-unit basis, of data composing said first data sequence is made 
30 close to a ratio of code amounts, on the cocfing-unit basis, of data composing said second data sequence cor- 

responding to said first data sequence. 

5. The method according to claim 1 to daim 4. further comprising: 

35 aoquinng a quantization scale used in quantizing data in said first moving picture coding system when said 

data is read from said first data sequence; and 

changing a quantization scale in said second moving picture coc£ng system to integer times the acquired quan- 
tization scale in the case where said generated code amount of said second data sequence is adjusted in cod- 
ing said present frame by said second moving picture coding system. 



40 



6. The method according to claim 1 to claim 4. further comprising: 



changing a quantization scale in said second moving picture coding system in the case where said present 
frame is coded by said second moving picture coding system and said generated code amount of said second 
45 data sequence is adjusted. 

7. A method for transforming a first data sequence generated by a first moving picture coding system to a second data 
sequence generated by a secorxf moving picture ooding system, comprising: 

so recording a code amount of a coding-unit in reading data of the ooding-unrt from said first data sequence; 

determining a target value of said generated code amount of said second data sequence on a coding-unit 
basis, said target value being obtained by multiplying a recorded code amount by a factor: and 
performing a rate control so that said generated code amount of said second data sequence comes close to 
said target value in generating said second data sequence from said data of the coding-unrt with said second 

55 moving picture ooding system. 

wherein a ratio of code amounts, on the coding-unit basis, of data composing said first data sequence is made 
close to a ratio of code amounts, on the coding-unit basis, of data composing said second data sequence cor- 
responding to said first data sequence. 
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8. The method according to claim 7. wherein said coding-unit is conprised of at least one frame. 

9. A method for transforming a first data sequence generated by a first moving picture coding system that switches an 
intra-f rame coding mode and an inter-frame coding mode on a block unit basis to a second data sequence gener- 

5 ated by a second moving picture coding system that siAntches an intra-frame coding mode and an inter-frame cod- 
ing mode on the block unit basis, corrprising: 

increasing the number of blocks to be coded by the intra-frame coding mode in said second moving picture 
coding system in the case where a generated code amount of said second data sequence does not reach a 
ic target value. 

10. The method according to claim 9. further comprising: 

recording a code amourit on a block unit basis in reading data on the block unit basis from said first data 
15 sequence; and 

using a value obtained by multiplying said code amount recorded on the block unit basis by a factor, as a target 
value of said generated code amount of said second data sequence. 

11 . The method according to daim 9 or daim 10, further comprising: 

acquiring a quantization scale used in quantizing data in said first moving picture coding system when sak:l 
data is read from said first data sequence: and 

changing a quantization scale in saxl second moving picture coding system to integer times the acquired quan- 
tization scale in the case where said generated code amount of said second data sequence is adjusted in cod- 
25 ing a present frame by said second moving picture coding system. 

12. The method according to claim 9 to daim 1 1 , wherein said block unit includes a frame or a macro titock. 

13. The method according to claim 9 to daim 12, further conrprising: 

30 

redefining a luminance variance of a motion compensated inter dock differential so that the intra trame coding 
mode is selected more to increase the numt^er of blocks to be coded by the intra-frame coding mode. 

14. The method according to daim 9 to claim 1 1 . further comprising: 

35 

shortening a period of intra-refreshing of a macro block belonging to a moving region to increase the number 
of blocks to be coded by the intra-frame coding mode. 

1 5. A method for transforming a first data sequence generated by a first moving picture coding system that switches an 
40 intra-frame coding mode and an inter-frame coding mode on a block unit basis to a secorp data sequence gener- 
ated by a second moving picture coding system that switches the intra-frame coding mode and the inter-frame cod- 
ing mode on the bUxk unit t)asis. comprising: 

increasing the number of blocks to be coded by the inter-frame coding mode in sakJ second moving picture 
45 coding system in the case where a generated code amount of said second data sequence exceeds a target 

value. 

16. The method according to daim 15, further comprising: 

so recording a code amount on the block unit basis in reading data on the btock unit basis from said first data 

sequence: 

using a value obtained by muKiptying said code amount recorded on the block unit kiasis by a fador, as a target 
value of said generated code amourrt of said second data sequence. 

55 1 7. The method according to daim 15 or claim 16. further conprising: 

acquiring a quantizatkxi scale used in quantizirig data in said first moving picture coding system when saKi 
data is read from said f iist data sequence; and 
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changing a quantization scale In said second moving picture coding system to integer times the acquired quan- 
tization scale in the case where said generated code amount of said second data sequence is adjusted in cod- 
ing said present frame by said second nooving picture coding system. 

5 1 a A method tor transforming a first data sequertce generated by a first moving picture coding system with an informa- 
tion loss caused by quantization to a second data sequence generated by a second moving picture coding system 
with an information loss caused by quantization, comprising: 

acquiring a quantization scale used in quantizing data in said first moving picture coding system when said 
10 data is read from sard first data sequence; and 

changing a quantization scale in said second moving picture coding system to integer times the acquired quan- 
tization scale in the case where said generated code amount of said second data sequence is adjusted. 

19. An apparatus for transtorming a first data sequence generated by a first moving picture coding system having an 
15 intra-frame coding mode and an inter-frame coding mode to a second data sequence generated by a second mov- 
ing picture coding system having an intra-frame coding mode and an inter-frame codng mode, comprising: 

a system(405) that prereads a coding mode of a successive frame succeeding a present frame from said first 
data sequence; 

20 a system(405) that judges whether a preread coding mode of said successive frame is the inter-frame coding 

mode or the intra-frame coding mode, and 

a syst©m(405) that determines whether or not to code said present frame tsy said second moving picture cod- 
ing system corresponding to a generated code amount of said second data sequence in the case where the 
coding mode of said successive frame is the intra-frame coding mode, wherein data coded by the intra-frame 
2S coding mode existing in said first data sequence is preferentially transformed to the second data sequence. 

20. An apparatus for transforming a first data sequence generated by a first moving picture coding system that switches 
an intra-frame coding and an inter-frame coding on block unit basis to a second data sequence generated by a sec- 
ond moving picture coding system that switches comprised an intra-frame coding and an inter-frame coding on the 

30 block unit basis, 

said apparatus inaeeses the number of blocks to be coded by the intra-frame coding mode in said second 
moving picture coding system in the case where a generated code amount of said data sequence does not 
reach a target value. 

35 

21 . An apparatus for transtorming a first data sequence generated by a first moving picture coding system that switches 
an intra-frame coding motie and an inter-frame coding mode on a block unit basis to a second data sequence gen- 
erated by a second moving picture coding system that switches the intra-frame coding mode and the inter-frame 
coding mode on the block unit basis. 

40 

said apparatus inaeases the number of t>locks to be coded by the inter-frame coding mode in said second 
moving picture coding system in the case where a generated code amount of said second data sequence 
exceeds a target value. 

45 22. An apparatus for transforming a first data sequence generated by a first moving picture coding system with an infor* 
matfon loss caused by quantization to a second data sequence generated by a second moving picture coding sys* 
tern with an information loss caused by quantization, comprising: 

a sy8tem(522) that acquires a quantization scale used In quantizing data in said first moving picture coding 
so system when said data is read from sak:i first data sequence; and 

a system(S22) that changes a quantization scale in said secorvl moving picture coding system to integer times 
the acquired quantization scale in the case where said generated code anmunt of said second data sequence 
is adjusted. 

55 23. A recording medium storing a program. readat>le by a computer, for transforming a first data sequence generated 
by a first moving picture coding system having an intra-frame coding mode and an inter-frame coding mode to a 
second data sequence generated by a second moving picture coding system having an intra-frame coding nxxle 
and an inter-frame coding mode, said program conprising: « 
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a procedure for prereadir^g a ccxling mode of a successive frame succeeding a present frame from said first 
data sequerH:e; 

a procedure for judging whether a preread coding mode of said successive frame is the intra-frame coding 
mode or the inter-frame coding mode, and 
£ a procedure for determining whether or not to code said present frame by said second moving picture coding 

system corresponding to a generated code amount of said second data sequence in the case where the coding 
mode of said successive frame is the intra-frame coding mode. 

24. A recording medium storing a program, readable by a computer, tor transforming a first data sequence generated 
10 by a first moving picture coding system to a second data sequence generated by a second moving picture coding 

system, said program compnsing: 

a procedure for recording a code amount on a coding -unit basis in reading data on the coding -unit basis from 
said first data sequence: 

15 a procedure for determining a target value of said generated code amount of said second data sequence on 

the coding-unit basis, said target value being obtained a recorded code annount by a factor; and 
a procedure for controlling a rate so that said generated code annount of said second data sequence comes 
close to said target value in generating said second data sequence from said data on the coding-unit t>asts by 
said second moving picture coding system, 

20 wtierein a ratio of code amounts, on the coding-unit basis, of data composing said first data sequence is made 

close to a ratio of code amounts, on the coding-unit basis, of data composing said secorKi data sequence cor- 
responding to said first data sequence. 

25. A recording medium storing a program, readable by a computer, tor transforming a first data sequence generated 
25 by a first moving picture coding system that switches an intra-frame coding mode and an inter-frame coding mode 

on block unit basis to a second data sequence gene^ated by a second moving picture coding system that switches 
an intra-frame coding mode and an inter-frame coding mode on the block unit basis, said program comprising: 

a procedure for increasing the number of blocks to be coded by the intra-frame coding mode in said second 
30 moving picture coding system in the case where a generated code amount of said data sequence does not 

reach a target value. 

26. A recording medium storing a program, readable by a conputer, tor transforming a first data sequence generated 
by a first moving picture coding system ttiat switches an intra-frame coding mode and an inter-frame coding mode 

35 on a l3lock unit basis to a second data sequence generated by a second moving picture coding system that 
switches an intra-frame coding nrKxIe and an inter-frame coding mode on the block unit basis, said program com- 
prising: 

a procedure lor increasing the number of bk)cks to be coded by the inter-frame coding mode in said second 
40 moving picture coding system in the case where a generated code amount of said second data sequence 

exceeds a target value. 

27. A recording medium storing a program, readable by a conputer, tor transforming a first data sequence generated 
by a first moving picture coding system with an information loss generated by quantization to a second data 

45 sequence generated by a second moving picture coding system with an information loss generated by quantiza- 
tion, said program conprising: 

a procedire for acquiring a quantization scale used in quantizing data in sard first moving picture coding sys- 
tem when said data is read from said first data sequence; and 
so a procedure for changing a quantization scale in said second moving picture coding system to integer times 

the acquired quantization scale in the case where saKi generated code amount of said second data sequence 
is adjusted. 



£5 



BNSDOCID <eP. .1032214*2 l.» 



15 



EP 1 032 214 A2 




BNSDOCIO <EP t032?i4A2.l. > 



16 



EP 1 032 214 A2 




BNSDOCID <EP_ 10322I4A2 i > 



17 



EP 1 032 214 A2 




BNSOCXrD <EP 10322UA2J_> 



18 



EP 1 032 214 A2 




BNSDOCID <EP_ 1032214A2 \ > 



19 



EP1032 214 A2 




EP 1 032 214 A2 




BNSDOCIO <EP 103221 4A2_L> 



21 



EP1032 214 A2 




EP 1 032 214 A2 




BNSOOCID <£P 1032214A2.I,> 



23 



EP 1 032 214 A2 




EP 1 032 214 A2 




BNSIXCIO <EP__ 1 03221 «A2 I > 



25 



EP 1 032 214 A2 




26 

BNSDOCID <EP 1032214A2J_> 



EP 1 032 214 A2 




BNSOOCID <EP._ 1032214A2 l.> 



27 



EP 1 032 214 A2 




















uu o 




- 




jp 




"^"^ 




a 








o z 








o o 




— flc 




^ <c 




•< 




3: 




o 


O 


CO ac 


UJ 


— ^ 










1 






-^O 


o 






-J 




>- < 


UJ 


> > 


QC 




< 












O 


Ui 


oe 


X X 












w . 




1— 








tu 

XU. 


OS 


» o 


-< 






z >• 




o »^ 












c3 — 








o — 








OS 




a. LU 




X 








o 






















CO 



28 

BNSDOCtD: <EP 1032214A2. 1 .> 



EP1 032 214 A2 




BNSDOCID <EP 10322UA2 I > 



29 



EP 1 032 214 A2 




EP1 032 214 A2 




31 

BNSDOCtD <EP_ 1 03221 4A2_1.> 



(19) 




Europaisches Patentamt 
European Patent Office 
Office europeen des brevets 



iiliiilllillil 



(12) 



(88) Date of publication A3: 

06.05.2004 Bulletin 2004/19 



(11) EP1 032 214 A3 
EUROPEAN PATENT APPLICATION 

(51) Intel- H04N 7/50. H04N 7/26 



(43) Date of publication A2: 

30.08.2000 Bulletin 2000/35 

(21) Application number: 0O1O389S.9 

(22) Date of filing; 24.02.2000 



(84) Designated Contracting States; 


• Uenoyama, Tsutomu 


AT BE CH CY DE DK ES Fl FR QB QR IE IT tl LU 


Kawasaki-sfii. Kanagawa 210-0022 (JP) 


MC NL PT SE 


• Iwasaki, Osamu 


Desiqnated Extension States: 


Tokyo 174-0074 (JP) 


AL LT LV MK RO SI 


• Komiya, Dalsaku 




Tokyo 166-0014 (JP) 


(30) Priority; 25.02.1999 JP 4761399 






(74) Representative: Grunecker. Kinkeldey, 


(71 ) Applicant MATSUSHITA ELECTRIC INDUSTRIAL 


Stockmair & Schwanhausser Anwaltssozietdt 


CO.. LTD. 


Maxtmilianstrasse 58 


Kadoma-shi, Oaaka 571-8501 (JP) 


80538 Mijnchen (DE) 


(72) Inventors: 




• Etoh, MInoru 




Kawasakl-shi Kanagawa 213-0013 (JP) 





CO 

< 

CM 
CO 
O 



LU 



(54) Method and apparatus for transcoding moving picture data 



(57) The transformation method for moving picture 
coding system reads data of a frame from the first data 
sequence in the first moving picture moving coding sys- 
tem, prereads a coding mode of a successive frame to 
record, and when the preread coding mode of the suc- 
cessive frame is the intra-frame coding mode, performs 



a control not to perform coding of a present frame or 
decrease a generated code amount corresponding to 
the generated coed content of the second data se> 
quence in the second moving picture coding system. 
Then, the method preferentially transforms data coded 
by the mtra-f rame coding mode existing in the first data 
sequence to the second data sequence. 



RECQBSTftUCTiair or SYSTEH-A IttGE MD 

amuA} m of inthheciau mta 




-J lEPfiOOUCED lUACE A90 NPTYPE. 
7 PcMtcnt.P1lll.TR.Ctf4. }.C6Pi. J. 
/ QUANTi.i.inmi.j.(IIVIi.i.lVYt.i). 
/ MLIDi.j.iOVi. i 

— ^^.^.^ 

lES 



ASAMtXM P«tS£NT lafUf FRAtt 
TO Skip AW) FO»C£0Lr SET 

pTrp£ Of Ntxi rmrni 

AT INTSA-CODIKC 



FIG.9 



Pnnlcd tKf Jouwc. 75001 PARtS (FRi 



8NSDOCID <EP_ 1032214A3 1. > 



EP1 032 214 A3 



Si 



European Pitoiil 
OHie* 



EUROPEAN SEARCH REPORT 



ftppteaHen Number 

EP 00 10 3895 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Citation of docunwrt with «idtcatK9n,«iriiara «p|)iopnaii, 
of PBiavant paa««ge> 



tooUtim 



CLASStFICATKlNOF THE 
APPUCA^ON (lnLa.7) 



WO 98 19460 A (CHRISTOPOULOS CHARILAOS 
; ERICSSON TELEFON AB L M (SE); BJOERK 
NIKL) 7 May 1998 (1998-05-07) 



* page 6, line 5 - line 37 * 

* page 22, line 1 • page 23, line 14 

* figure 1 * 

EP 0 711 077 A (AT & T CORP) 
8 Hay 1996 (1996-05*08) 



* column 5, line 43 

* colunn 10, line 6 

* figures 1,6 * 



column 6, line 27 
column 14, line 44 * 



JENQ-MEMG HWAflG ET AL: 'Oynamic 
frame-skipping in video transcoding" 
MULTINEDiA SIGNAL PROCESSING, 1998 IEEE 
SECOND WORKSHOP ON REDONDO BEACH, CA, USA 
7-9 DEC. 1998. PISCATAWAY, NJ, USA.IEEE, 
US. 

7 Oecenter 1998 (1998-12-07), pages 
616-621, XP0ie318272 
ISBK: e-7803-4919-9 
* paragraph [6004] * 



T>« prmnl tMfcfi rvpoil has bMn drawn t« lor «M ctam 



1-27 



3-6.8, 
10-12, 
16.17 



3-6.8, 
10-12, 
16,17 



1-27 



H04N7/5O 
H04N7/26 



TECHNICAL REUS 



MUNICH 



Oc* or oanwMDn or mo Mfl 

8 March 2004 



CATCGOnV OF CtT£0 DOOUMEPff 6 



Kuhn. P 




f««n«^al Mina pitom tamiiy. oon«von«ng 



BNSOOCID <£P _ i0322!*A3 I > 



2 



EP1 032 214 A3 



European Patent 



EUROPEAN SEARCH REPORT 



Appllealton Numbar 

EP eO 10 3895 



DOCUMENTS CONSIDERED TO BE RELEVANT 



C«to90fy 



Crtation ol document with indicatioif , whw« appopnato. 
ofratavantc 



Ralavant 
toetaim 



CUS3IFICATK>N0FTH£ 
APFUCA110N (lnlCI.7) 



JEN0*NEN6 HWANG £T AL: "Motion vector 
re-estimation and dynamic frame-skipping 
for video transcoding' 
SIGNALS* SYSTEMS & COMPUTERS. 1998. 
CONFERENCE RECORD OF THE THIRTY-SECOND 
ASILOMAR CONFERENCE ON PACIFIC GROVE, CA, 
USA 1-4 NOV. 1998, PISCATAWAY, NO, 
USA, IEEE, US, 
1 Novent)er 1998 (1998-11-01)* pages 
1606-1616, XP010324479 
ISBN; 0-7803-5148-7 

* paragraph [0804] * 

* figure 3 * 

dJOERK H ET AL: "TRANSCODER ARCHITECTURES 
FOR VIDEO COOING- 

IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 
IEEE INC, NEW YORK, US, 
vol . 44, no. 1, 

1 February 1998 (1998-02-01), pages 88-98, 

KP000779254 

ISSN: 0098-3063 

* page 90, right-hand coltimn * 

JEONGNAN YOUN ET At: "Adaptive motion 
vector refinement for high performance 
transcoding" 

IMAGE PROCESSING, 1998. ICIP 98. 
PROCEEDINGS. 1998 INTERNATIONAL CONFERENCE 
ON CHICAGO, IL, USA 4-7 OCT, 1998. LOS 
ALAMITOS, CA, USA, IEEE COMPUT. SOC. US, 
4 October 1998 (1998-10-84), pages 
596-600, XP810586804 
ISBN: 0-8186-8821-1 

* figures 2,3 * 

-/" 



1-27 



1-27 



1SCMNICAL FIELDS 



1-27 



Th» pr«Mnt March report hn been tirwm up for atl claims 



MUNICH 



0«* ol eorrpMiJOn emm mm 

8 March 2004 



Kuhn, P 



CATEGOnV OF CrTED OOCUMEKTS 



X pvtMulBs1)r •t)m«miW«fi«lom 



7 thwry or pMK^ MiKlaflrtog inwiiiaii 
E : 9Mh»r paftiwt docuwri t . but pObfchad on, ot 

D 
L 



a : m<iHb«fqf 9m aama pinitf tewly. (oorma^n 



BNSOOCID <EP. 103221 4A3 i> 



EP1032 214 A3 



£urep«aii Patent 
OffiM 



EUROPEAN SEARCH REPORT 



A^HcxIlun ttumbrr 

EP Oe 10 3895 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Ctfagoiy 



CiliSion of docufn«nt with indicalion.whcra appropriate, 
of retovant pagaaqes 



Relevant 
to claim 



CtASSmCATlON OF THE 
APPLtCAItON (imCl.T) 



ASSUNCAO P A A ET AL: "A buffer control 
algoritmn for CBR video transcoding" 
IMAGE PROCESSING, 1998. ICIP 98. 
PROCEEDINGS. 1998 INTERNATIONAL CONFERENCE 
ON CHICAGO. IL, USA 4-7 OCT. 1998, LOS 
ALAMirOS. CA. USA, IEEE COMPUT. SOC, US, 
4 October 1998 (1998-10-64). pages 
378-374, XP0103O8491 
ISBN: e-8186-882M 
* page 371, paragraph 3 - page 372 * 



1-27 



lECHNICAtFKLOa 
SEARCHED dJltCLI) 



Tha praaanl aaanh naport has bsan drown up far all cUimt 









MUNICH 


8 March 2804 


Kuhn, P 



CATCOOAV Of CfTEO OOCUMEKTS 




r ttMory Of pf«na^ undnVa^ ttw iaMiatan 
E : •ariiir patent daeumMt bill piMaliad on. a 

^r»*amgd«te 

0: ^ 



• patMillwnlyt 



BNSCXXID <EP 1032214A3.I.> 



4 



EP 1 032 214 A3 



ANNEX TO THE EUROPEAN SEARCH REPORT 
ON EUROPEAN PATENT APPLICATION NO. 



EP 00 10 3B95 



This annesi listft Xfm p«t»nt family mambsn ratalinQ to the palant documsnis 
Th» mmnbeiB are as cont«in«i in the EuropMn Patent Offios £0P fde on 
Vm EuropMn Potent Offio* m in no way Kafato (or Ihoaa ptrtioulRit which am 



oiled in tlM» abow-nwntaonad EuQpsan search report 



givsn for lha purpoee of intonnatton 

08-03-2004 



Patent document 
dtadnMOfoh report 





Ratwit lamily 


P^tilicalion 






date 


SE 


515535 C2 


27-08-2001 


AU 


4798997 A 


22-05-1998 


CN 


1234943 A 


10-11-1999 


EP 


0934661 Al 


11-08-1999 


JP 


2001563225 T 


06-03-2001 


SE 


9603909 A 


26-04-1998 


MO 


9819460 Al 


07-05-1998 


US 


6526099 Bl 


25-02-2003 


US 


5667095 A 


11-11-1997 


CA 


2159B46 Al 


02-05-1996 


EP 


0711077 A2 


06-05-1996 


JP 


8242451 A 


17-09-1996 



WO 9619460 



07-05-1998 



EP 0711077 



08-05-1996 



i For nfwradelaib about this mex: aeeOfheiaiJoufflatoftfie European Patent Office, No. 12A2 



BNSDOClD. <EP t0322t4A3.l > 



This Page is Inserted by IFW Indexing and Scanning 
Operations and is not part of the Official Record 



Defective images within this document are accurate representations of the original 
documents submitted by the applicant. 

Defects in the images include but are not limited to the items checked: 

>□ BLACK BORDERS 



□ SKEWED/SLANTED IMAGES 

□ COLOR OR BLACK AND WHITE PHOTOGRAPHS 

□ GRAY SCALE DOCUMENTS 

□ LINES OR MARKS ON ORIGINAL DOCUMENT 

□ REFERENCE(S) OR EXHIBIT(S) SUBMITTED ARE POOR QUALITY 

□ OTHER: 

IMAGES ARE BEST AVAILABLE COPY. 
As rescanning these documents will not correct the image 
problems checked, please do not report these problems to 
the IFW Image Problem Mailbox. 



BEST AVAILABLE IMAGES 




□ IMAGE CUT OFF AT TOP, BOTTOM OR SIDES 




□ FADED TEXT OR DRAWING 



BLURRED OR ILLEGIBLE TEXT OR DRAWING 



